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Exercise  and  JEFX  Experience 


•  JEFX  1999  AFRL/HEA 

-  Warfighter  Operations  Centers 

•  JEFX  2000,  AFRL  HEA  &  AFEO  Assessment  Team 

-  CAOC  Time  Sensitive  Targeting 

•  JEFX  2000,  AFEO  Assessment  Team 

-  JAOC  Time  Sensitive  Targeting 

-  Human  Factors  &  Opns  Effectiveness 

•  Schreiber  I  and  II  (Capt  Del  Vecchio) 

-  SWC  and  SMC/XR  (Transformation  Div) 

-  Weapon  System  Effectiveness 

•  Virtual  Flags,  AFRL-HEA 

-  BCC-X  Training  Requirements 

-  Operator  Effectiveness 

•  JEFX  2004,  ESC  &  AFEO  Assessment  Team 

-  Battle  Control  Center-Experimental 

-  Tactical  Battle  Management  Command  & 
Control 

-  Human  Factors/Ops  Utility  Assessments 
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inS>/l3  A  story  from  the  Field 


•  Nuclear  power  plant  operators  have  to  periodically  go  to  simulator 
and  pass  a  certification  test 

•  Assessors  evaluate  performance  to  ensure  that  operators  have  the 
expertise  that  is  required  to  operate  the  plant  safely  and  effectively 
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A  Story  from  the  Field 
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Role  of  Human  Operator 


The  role  of  the  human 
operator  in  today’s 
eomplex  soeio-technical 
systems  is  to  adapt  to  the 
unanticipated  variability 
inherent  in  a  dynamic 
operational  environment 


•  Un-amused,  the  assessors  cited  the  operators  for  “malicious 
compliance  with  procedures" 


•  Frustrated  by  repeated  “write-ups”  for  faiiure  to  comply  with 
established  procedure  they  decided  to  perform  next  simulation 
strictly  “by  the  book” 


|n®H3  Role  of  Technology 


The  role  of  the  technology 
in  these  systems  it  so 
support  the  development 
and  deployment  of 
operators’  adaptive 
strategies  in  the  face  a 
dynamic  task  environment 
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Defining  Rigor:  A  Human-Centric 
Perspective 


•A  OTS  assessment  is  rigorous  to  the  extent  that  it 


-  provides  analysts  with  insight  into 
and  understanding  of  the 
mechanisms  and  strategies  of  human 
operators  to  adaptively  cope  with 
the  complexities  of  a  dynamic, 
uncertain,  and  high  consequence 
operational  environment. 

-  demonstrates  the  extent  to  which 
technology,  in  all  its  forms,  supports 
the  coping  strategies  of  human 
operators  and  enhances  overall 
system  performance. 


0S35  Coping  Strategies 


•  Accept  reduced  performance  -  all  tasks  will  be 
performed  but  at  lower  performance  levels 

•  Shed  load  -  prioritize  across  tasks  and  activities, 
dropping  out  those  considered  low  priority 

•  Redistribute  work  demands  -  shift  work  to  other 
local/distributed  operators  or  automated  agents 

•  Reduce  Operational  Tempo  -  manage  the  processing 
tempo  resulting  in  less  work  per  unit  time 


lilGHS  Shaping  Conditions  of  Observation 

mmtft  • f  ^  ^ 


“There  is  a  need  to 
orchestrate  varieties  of 
observation  that  are 
diverse  in  how  they  shape 
(and  therefore  distort)  the 
processes  we  wish  to 
observe  and  understand” 


Woods  &  Hollnagel  (2006) 


« IMJbf  VfflxK.  rl 
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jn©33  What  makes  OTS  Assessment  difficult? 


'  Complexity  of  Operations:  What  do  you  look  for? 
I  Context  sensitivity:  Every  instance  is  different 
'  Goal  conflicts:  Avoiding  goal  fixation 
'  Distributed  nature  of  work 
'  Observability:  Getting  inside  the  head 
'  Operator  variability 
'  Process  vs  Product 
'  Plans  vs  Situated  Action 
'  Metrics  and  measures 
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|ilS^3  How  can  OTS  support  analytical  rigor? 


•  Explain  and  substantiate  (not  just  “what”  but  also 
“how”  and  “why”) 

•  Avoid  premature  narrowing  (iterative  process  of 
broadening  and  focusing) 

•  Exploit  the  dual  status  of  prototypes 

-  Tools  for  discovering  new  aspects  of  dynamic  demands  and 
constraints  of  operational  domains  (test  onr  assumptions) 

-  Hypotheses  of  what  will  be  useful.  Refined  product  to  support 
operators  in  the  pursuit  of  operational  goals  and  objectives. 


11 


injiHs 


Lessons  Learned  from  the  Field: 
Best  Practices  for  OTS  Assessment 


Recommendations 


Data  Analysis  & 
Findings 

Data  Collection 

Preparation 
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lilSiHS  Preparation:  Building  Expectations 

ntmtft  • - - - f  ^  ^  ^ 


•  Literature  Review 

-  Doctrine 

-  Test  and  Field  Reports 

-  Experimentation  Plans 

-  Concepts  of  Operations 

•  Technology  CONOPS  development 

-  What  purpose  does  technology  serve  (design  intent) 

-  Anticipate  consequences  of  technology  change 

-  Establish  expected  outcomes 

-  Develop  conceptual  model  of  the  work  system 

•  Scenario  Generation 

-  Participation  in  development  of  MSEL  to  enable  anticipation  of 
interesting  situations  and  opportunities  for  data  collection 

13 


0S35  Data  Collection  and  Observation 


•  Surveys 

-  Use  surveys  to  guide  and  direct  observation 

-  Identify  specific  challenging  activities  or  things  that  will  likely  prove 
problemaiic 

-  Leverage  operational  patterns  seen  across  domains 

-  Generate  survey  questions  that  will  expose  problem  areas  and  unique 
challenges 

•  Observation 

-  Capture  unique  aspects  of  operator  behavior 

-  Look  for  variations  in  strategies  across  operators 

-  Record  operators  to  extent  possible  to  support  follow-up  sessions  with 
operators 

-  Think  Aloud  techniques 

•  Interviews 

-  Follow-up  sessions  with  operators  to  review  critical  incidence,  provide 
more  in-depth  understanding  of  performance  and  task  strategies 
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Data  Analysis,  Findings  and 
Recommendations 


•  Pursuing  causal  explanations 

-  Interpretation  of  data,  why  did  we  see  what  we  saw 

-  What  was  impact 

•  Identify  how  technology  changes  work 

-  Mapping  observation  to  expectations 

•  In  response  to  mission  events 

•  In  response  to  technology 

-  Identify  unintended  consequences  of  technology 

•  Refining  models  and  assumptions 

-  How  did  observation  change  expectations 
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lil©HS  Understanding  Adaptive  Control 


Perceiving 


Synthesis 


Real-Time 

Operations 


Real-Time 

Situation 

Assessment 


CONTROL 


Effects-based 

Evaluation 

And 

Planning 


COMMAND 


Acting 
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lilSiHS  Combat  Air  Operations  Example 

-* - - - ( 


Perceiving 


ATO 


Engaging 


Intelligence 
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JEFX  Introduction 


Joint  Expeditionary  Force  Experiment:  A  series  of  spiral  developments  | 
culminating  in  an  operational  experiment  designed  to  prepare  the  USAF  for  j 
the  challenges  of  21* *^  Century  Expeditionary  Aerospace  Force  operations  j 


•  Explores  a  set  of  focus  areas  through  spiral  development  of  new 
systems  (technology)  and  process  initiatives 

•  Attempts  to  anticipate  and  create  future  C2  systems  based  on  desired 
capabilities 

•  Not  a  laboratory  experiment  in  the 
classical  sense 


Too  many  new  systems 
Many  uncontrolled  variables 
Designed  for  process  exploration 
Not  training  or  testing 


Mar 


Jun 


Aug 


Sep 
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me;)3  JEFX  2000  Big  Picture 


Initial  Perspective 


•  Over  2200  Participants  at  8  primary  locations 

•  35  Computer  Models/Simulations  injecting  from 
different  locations 

Approximately  1200  Sorties/day,  250  messages/hour 

-  241  M&S  support  &  56  scenario  controllers 

•  Virtual  Cockpits  (Weapon  System  Simulators) 

-  F-15C/E,  F16C,  Rivet  Joint,  JSF,  ABL,  AWACS 

•  77  Aircraft  in  “live-fly”  at  Nellis 

•  60+  System/Process  initiatives 
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inS>/l3  Theater  Air  Control  System  (TAGS) 


Joint  Force 
Commander  (JFC) 


Air  Operations  Center 
(AOC) 


Wing  Operations 
Center  (WOC) 


Controi  Reporting 
Center  (CRC) 


1 

Space 

Operations 

Joint  Forces  Air 
Component  Commander 
(JFACC) 

Airborne 

Eiements 

Air  Support  Operations 
Center  (ASOC) 


1 

- ,  - 1 

Controi  Reporting 

( 

^  Tacticai  Air 

-  Controi  Party  (TACP) 

Eiement  (CRE) 
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|n®H3  Organizational  Relationships 


SIDO 


Air  Mobility 
Division 
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JBIM 

® 

DWS  Phone 

_ ^  MUST  ^  ; 

j  j  Radios  ^  ; 

i 

5-D-a\\er 

Safe 

1  KDWS  X 

STE(  Secret) 

Server 

BP 

Printer _ 

- . -  1  1 

SYS  AD 
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Time  Critical  Targeting  Cell 
System  Connectivity 
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|n®H3  Assessments 


Organized  operations  to  anticipate  TCTs  not  in  the  ATO  and  orchestrate 
operations  to  negate  mobile  surface  targets  within  their  operating  cycles 


Prosecution  of  Time  Critical  Targets 


(F2T2EA) 


Find 


r 


Track 


r 


Engage 


U 


/ 

Fix 

U 


Target 


Time  ■ 
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meas  TCT  Thread 


TCT  Thread:  A  group  of  processes  &  systems  initiatives 
that  work  together  to  support  execution  of  Time  Critical  Targets 


•  Process  Initiatives  (6)  --New  ways 
of  doing  business  (Doctrine, 
Organization,  Training,  Materiel, 
Leadership  &  People) 

-  Battle  Control  Center  (BCC)  JEFX 
99  Carryover 

-  Intelligence,  Surveillance 
Reconnaissance  (ISR) 


•  System  (Technology)  Initiatives  (70) 
“New,  existing,  or  commercial 
systems  to  determine  operational 
capability 

•  TCT  Technology  Initiatives 

-  Talon  Gateway 

-  Mission  Analysis  Tracking 
(MATTS/ITE) 

-  Bomber  Enhanced  Tactical  Interface 
(BETI) 

-  Project  Suter 

-  Panther  Den 

-  Attack  Ops  Decision  Aid  (AODA) 

-  TBMCS/Army  BCS  Interoperability  39 
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Battle  Commander 
Workstation  Connectivity 


Predator  Feeds 


I 


CAOC 

Indian  Springs  | 

Indian  Springs  | 

White  Cell  Coord’nte 

OPS  cell  &  Bird  Mvmt| 

OPS  cell  &  Bird  Mvmt  | 

Ele. 


Power  Scene 
Fuses  Picture 


Elec. 


Pvt. 

Chat 


Pvt. 

Chat 


Tel.. 


JSWS 

MTI,  TIBS,  SAR 


Elec. 


Library  Images 


Elec. 

— ► 


Tel. 


Technical  Help 


Battle  Commander  /  BC  Workstation 


Call  Sign:  BC 

Mission:  Performs  services  of  Predator/ 
Imagery  Analyst—Analyzes  imagery 
from  Imagery  Interpretation  Reports, 
associate  track  numbers  with  platforms, 
draws  imagery  from  field  and  national 
assets,  and  any  and  all  sources. 


IWS 

Voice 


IWS 

Txt 


Sensor 

Location  Coordinator 


Hunter  Chat 
Room 


IWS 

Voice 


Director  1/2 
Movement 


F2F 


Fusion 


A 

Aiws  ^ 

|Txt  \ 

F2F 

T  Elec. 

Ele. 

HSI  Predator  | 

Coordination,  Verify  ID 

_ 

U-2  LNO 

U-2  Feeds 

Shared  TRML  Asset 

SCIF 

1 

LSD 

Posts/Checks  Display 

•  Directs  movement  of  the  predator  by  positioning  pointer,  Has  15  Input/output  commo  port^^ 
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Example  AFRL/HEAI  Message 
Transmission  Capture  Form 


Collector:  Garrambone _ Date _ 6  Sep  2000_  Start  _1759_  End  2200 _ Page  _1 of 8 

Cell/Section _ Hunter _ Physical  Location ^Director  1  corner _ Episode _ Day  3 _ 


Time 

Zulu 

Mode 

Type 

From 

To 

MSG  Gist 

RFI 

Coor 

Ord 

Up 

Date 

Res/ 

Conf 

1. 

1757 

c 

HL 

All 

Radio  Cheek  lAll  eome  un) 

X 

2. 

c 

D2 

All 

Set  un  man — prepare  symbology 

X 

3. 

c 

HL 

Tgt 

Is  your  radio  working 

X 

4. 

1800 

c 

D1 

SCIF 

Is  your  radio  working 

X 

5. 

c 

D2 

All 

Reporting  downed  erew  member — CSAR  Mission 

X 

6. 

1801 

c 

Rvn 

All 

JSTAR  in  AO 

X 

7. 

c 

D1 

All 

Foeus  on  two  possible  targets 

X 

8. 

1802 

c 

D2 

Sen 

Provide  ISR  asset  status  eheek 

X 

9. 

c 

JBIM 

D1 

Radio  eheek 

X 

10. 

1803 

F 

HL 

BDA 

Coordination 

X 

11. 

F 

D2 

D1 

Note  4  targets  on  sereen — remove  these  two 

X 

12. 

1804 

c 

D1 

Img 

Are  these  tgts  from  yesterday? 

X 

13. 

F 

HL 

TCTC 

Coordination 

14. 

F 

D2 

D1 

Showing  too  mueh  detail  in  grid  box 

X 

15. 

1807 

C 

D1 

HL 

Too  mueh  detail  and  indistinguishable  eolors 

X 

16. 

c 

Rvn 

D2 

I’ve  determined  traeks  on  two  tgts 

X 

17. 

1808 

c 

Fus 

D2 

Sereen  elears  when  transition  takes  plaee 

X 

18. 

1809 

c 

Sen 

HL 

Provide  information 

X 

19. 

F 

HL 

Sen 

Coordinating  information 

X 

20. 

c 

D2 

D1 

Status  of  SA-10  in  listing  eolumn  of  data? 

X 

R  =  Radio  Trans/Rec  B  =  IWS  BBS  F  =  Face-to-Face  Ord  =  Order 

L  =  Large  Sereen  Display  A  =  IWS  Audio  P  =  Person-to-Person  Res/Conf  =  Response/Confirmation 

D  =  DIS  Net  T  =  IWX  Text  S  =  Sneaker  Net  RFI  =  Req  for  Information 

T  =  Telephone_ C  =  1 6  ehannel  phone  PA  =  Publie  Address_ CB  =  Crib  sheet 
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Example  Hunter  Section 
Voice/Visual  Message  Traffic 


ISR 

Hunt 

TGT 

CAOC 

CMD 

ISR 

28 

24 

1 

C 

2 

Hunt 

33 

11 

6 

2 

15 

TGT 

4 

10 

4 

0 

1 

CAOC 

C 

2 

0 

7 

7 

CMD 

2 

19 

4 

7 

7 

Total 

67 

66 

15 

2 

18 

Note.  168  messages  caught 
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0S35  Communication  Forms  &  Ports 


Electronic  Products 


VSTARS 

JTIDS 

Predator  Images 


16  Pipe  DIS  Net 
IWS  Audio 
Public  Addr  Sys 


ACCESS  Comm 
Sneaker  Net 
Secure  Telephone 


TBMCS  SAA/ATT 
SPINS  &  IPB 
SAA  Display 
SOLIPSIS  Display 
TG  /  RPTS 


•  Predator  Library 


Telephone 


Face-to-Face 


Section  Chats 


•  AODA 


Paper  Products 


Digital  Picture  Section  Net 


Special  Products 


•  Smart  Pack  1 

•  Smart  Pack  2 

•  Smart  Pack  3 

•  Operator  Checklist 

•  Threat  Sys  Hndbk 

•  Operation  Hndbk 

•  Written  Msgs 

•  Coord  Cheat  Sheets 


IWS  Chat 
Face-to-Face 

Sneaker  Net 
Screen  Display 


PVT  Chat 
DIS  Net 
Secure  Voice 
FAX  Line 


Electronic  Msgs  Hardwire  Ports 


Large  Screen  Display 
Private  Chat  Rooms 
Secure  FAX 
OPS  Briefings 
SA  Briefings 
Pilot  Debriefings 
Tools/ Apps  Briefings 
On-call  support 
Computer  Crossovers 
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!>!®35  Team  Work  Observations 


•  Internal  Process  Review 

•  Shortfall  Analysis 

•  Operational  Discussion 

•  Team  Innovation 

•  Process  Adaptation 


•  Cross-talk 

•  Sneaker-net 

•  Display  alerts 

•  Fusion  Nodes 

•  Task  partitioning 

•  Task  sharing 

•  Info  pull/push 

•  Cohesion  meetings 

•  Definitions 

•  Documentation 

•  Questions/agreements 
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Example  TCTC  ^ 

““  Work/Target  load  Chart  ^ 

P 

TCT  Workload  Mea 

Recorder  Garrambone 

urement  Cha 

Starting  DTG 

E 

ndina  DTG 

Nex 

Hour  2  Nex 

Hour 

36 

22 

=  Comr 

nand  Directe 
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-q 

FI 

-T- 

T“ 

16 
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T17 
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T13 
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BD 

A 

T12 

Wpn  Rel  Rpt 

T12 

BD 

A 

T11 

BDA 

T5 

V 

^5^ 

BDA 

BD 

/  Predator 

\  \ 

T5 

fc.  BD7 

PIREP 

T3 

T3 

BD/  SOF 

1  1356 

T1 

T1  Det. 

y 

BD/  U-2 

1  4603 

12 

u-2  T2  Det 

□roDDed 

T3 

siGh  T3 

Det  Prom. 

oted 

3  1357 

T4 

Pilot  T4 

Det 

Droc 

5  4605 

I§ 

T8 

u-2  T5  [ 

HSI  I 

)et 

'6  Det 

Promote 

I 

7  Det 

Promoted 

HSI 

T8  Det 

dropped 

T9 

T9  Det 

Exolovb 

T11 

SCI 

T11 

Promote 

T12 

T12  [ 

)et 

Promotet 

T13 

T13  [ 

)et 

Promote 

12  414 

T14 

'14  Det 

14  1374 

T17 

■ 

T17  Det 

■ 

T18 

T18  Det 

d 

16  1663 

T21 

T19  Det 

Dropped 

ReT 

18  4624 

.  T20  Det 

T21  Det 

F  omoted 

T22 

T22  Det 

T24 

T24  Det 

Pror 

T25 

T25 

Det 

#DTL 

tee - 

te^50 

3  6  6 

5  4  ^ 

4  4  6 

6  5  1 

5  4 

2  4  3  3  . 

3  4  6  6  6 

6  6  7 

7  6  6. 

7  8  10 

9  10  10 

jriod 

10  10  12 

11  9 
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|n®H3  Human  Element  Implications 


•  Evolving  C2  Centers  present  dynamic  challenges 

•  JEFX  -  good  venue  to  gain  Human  Factors  insights 

•  New  technology  /  forms  of  automation  -  pros  &  cons 

-  Operators  reverting  to  ^‘tried”  and  ^‘true”  when  automation  failed 

•  New  technologies  and  processes  necessitate  new  methodologies  and 
processes  for  operator  training 

-  New  mindset 

-  Big  picture,  consequences,  multiple  qualiBcations,  etc 

•  Individual  operator  and  team  development  implications 

•  No  more  pick  up  teams  -  well  honed  and  integrated 

•  Human  element  requires  at  least  equivalent  attention  /  emphasis  as 
technology  and  process  acquisitions 

•  Lots  of  unmade  charts  (time  sensitive  to  CSAF  De-briefings) 
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Summary  Training 
Observations 


•  JEFX  participants  recognized  the  need  for  more,  better  training 

•  Operational  training  on  new  systems  was  critical  to  the  success  of 
TCTC 

•  Training  shortfalls  generated  need  for  numerous  workarounds 

•  New-essential  training  took  place  every  day 

•  It  was  requested  by  operators,  was  formal  and  informal,  and 
practiced  as  a  result  of  the  pressure  of  the  operations 

•  Combat  operations  require  C2  training  on  numerous  subjects  to 
provide  error  free  rapid  performance  at  critical  times 

•  Training  has  to  create  the  image  of  ^^doing  it  right”  in  the  mind 
of  the  operator 
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JEFX  04  Assessment 


C2ISR  at  the  tactical  level 


The  work  of  the  Air  Control  Squadron 
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mens 


Missions  of  the  Air  Control 
Squadron  (ACS) 


“Battle  Management  Command  and  Control” 


•  Air  Battle  Management 

•  Surveillance 

•  Combat  Identification 

•  Weapons  Control 

•  Data  Link  Management 

•  Theater  Missile  Defense 


“Centralized  Control  and  Decentralized  Execution” 
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Premise  for  BCC-X 

The  Transformation  of  CRC  (MCE-Equipped)  to  BCS  (  Future-Equipped) 


Present^ 


Transformati 


Future 


MCE 

Equipped 

CRC 


Designed-  Field 
-t/  Tested  Equipped 
BCC-X 


Capabilities  now 

Analysis 


Future 

Equipped 

BCS-M 


Capabilities  Future 


Applications  of  Science, 
Engineering,  Technology, 
and  new  TTPs 
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4 "Box" 
Operation 


Reasons  for  Transformation 


"Finger  on  Glass" 

Dar'k,  Claustrophobic- 
Work  l^hvironmeiit 

™  Operators! 
^  way  ton 

find 

^tisfy 

Obsolete  Technology 

w/SplitTeam 

mission  reJ 

lirements 

w/Dead  Spots 

lilO/IS 


Defining  the  BCC-X 
New  Systems 


Generic  System 

Some  Example  Systems 

Situational  Awareness  System 

TDF-like,  Thales/Raytheon-like,  X-like 

Intelligence  Information  Fuser 

Multi-Source  Correlator  Tracker,  other  correlators-fusers 

Mobile  Operations  Facility 

OMs,  GP  Med  Tent,  3-in-l  Shelter,  Temper  Tent 

Environmental  Control  Units 

600  BTU,  660  BTU,  etc. 

Communications  Radio  Systems 

AVTEC,  ASTI,  others 

Air  Defense  Warning/track  Sys 

TAD  MTS,  ADSI,  SIS 

Data  Links,  Networks,  Flows 

SATCOMs,  Remote  Radio,  Satellite,  BUG-E 

Mobility  Systems 

Mobilizers,  M9I3  Bridge  Trucks,  S&T  Trailers 

Robotics  Sensors 

UCAV,  Predator  Feeds,  GH,  SWARM 
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Offutt 
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A  Distributed  Experiment 


|n®^3  BCC-X  and  RCC  Locations 
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|n®H3  BCC-X  JEFX  04  Assessments 

Types  of  Analyses  for  Assessment 

Target  of  Analyses 

• 

System  Analysis  of  BCC-X  Systems 

Devices/systems 

• 

Operations  Analysis  of  Processes 

Operators 

• 

Operational  Assessment 

Mission 

• 

Operational  Utility  Assessment 

Warfighter  value 

• 

Engineering  Technical  Assessments 

Specifications 

• 

Performance  Measurement 

Baselines 

• 

Human  Factors  Assessment 

HF  Operations 
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inS>/l3  BCC-X  Assessment  Team 


ESC  BCC-X 

ACC  BCC-X 

BCC-X  1 

Project  Manager 

Assessment  Leader 

Commander,  133d  TS  | 

ILt.  Danyawn  M.  “D”  Miles  Major  Matthew  R.  Webb  Major  Robin  A.  Hosch 

ESC/ACM  ACC/DOGY  133d  Test  Squadron 


Mr.  Jason  S.  Hamblen  Mr.  David  D.  Nitzel 

Odyssey  Systems  Consulting  46th  Test  Squadron 
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Operational  Equipment 
Comparisons 


Four  Operations  Modules 


WT.  1 8K  Lbs  X  4  =  72,000  Lbs 
SF.  4  sections  +  4  Mobilizers 
16  Operations  Consoles 
8  ECUs  600  Lbs=  4800  Lbs 
SF  2x3x8  =  48  SF  Area 


Two  3-in-l  Shelters 


WT.  15K  lbs  X  2  =  30,000  Lbs 
SF.  2  sections  +  2  Mobilizers 
16  Operations  Consoles 
4  ECUs  700  Lbs=  2800  Lbs 
SF  3x5x2  (stacked)  =  30  SF  Area 
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JEFX04  BCC-X  3-n-l 
Shelter  Configuration 


0  1  2  3  4  5  6  7  8  9  10  11  12  13  14  15  16  17  18 


o  Mission  Support  Suite 


Tactical  Operations  Center 


~~fj\ 


- ON 


- 00 


- NO 


Ceiling  Height  =  7’  21’- 4” 

MX  =  Maintenance 

ICT  =  Interface  Control  Tech  DST  =  Data  Systems  Tech  SD  =  Senior  Director 

RICT  =  Regional  Interface  Control  Tech  AST  =  Air  Surveillance  Tech  ADA  =  Air  Defense  Arty 

SYSAD  =  System  Admin  ASO  =  Air  Surveillance  officer  OC  =  Operations  Coordinator  (NCO) 

ST  =  Surveillance  Tech  WD  =  Weapons  Director  MCC  =  Mission  Control  Commander  5 1 
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|n®H3  Information  Capture 


•  Literature  &  documentation  reviews 

•  Structured  interviews 

•  Operator  daily  surveys 

•  Spot  and  activity  reports 

•  Player’s  general  observations 

•  Ops  planning  meeting  extracts 

•  Solicit  thoughts,  ideas,  &  opinions 

•  De-brief,  hot  wash  &  post-ops  results 

•  Electronic  data  capture  (some) 

•  On-station  observations 

•  Reviews  and  final  comments 


Tactical  Command  and  Control 
Over  Time 
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Combat 

Scenario 


New  Systems 
Data 


Missions 

and 

Tasks 

Operator 

Knowledge 

Operational  Environment 


Notional 
New  Combat 
Situation 
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System 


Improved 

Operator 
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Performance 


Command  &  Control  Operator 
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JEFX  04  BCC-X 
Air  Control  Team 
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JEFX04  BCC-X  3-n-l 
Shelter  Configuration 
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Mission  Support  Suite 


Tactical  Operations  Center 


-00 

MX  =  Maintenance 
■  ^  ICT  =  Interface  Control  Tech 

RICT  =  Regional  Interface  Control  Tech 
i_k  SYS  AD  =  System  Admin 
®  ST  =  Surveillance  Tech 


Ceiling  Height  =  7’ 

DST  =  Data  Systems  Tech 
AST  =  Air  Surveillance  Tech 
ASO  =  Air  Surveillance  officer 
WD  =  Weapons  Director 


21’- 4” 

SD  =  Senior  Director 

ADA  =  Air  Defense  Arty 

OC  =  Operations  Coordinator  (NCO) 

MCC  =  Mission  Control  Commander  57 


SATCOM 


Live  Range  Radar  Data 
Live  TPS-75  Radar  Data 
Link-16  RF  -  T1 


CAOCN 


DIS  Voice  (speech) 
DIS  Data  (sim) 

IWS  Text  (msg) 

Socket  J  (Router,  TCPIC) 
Serial  J  (Dial-up,  RS232) 

NIPR/SIPR  Net 
DSN:  Voice,  phone 
VOIP  (speech) 

STE  Voice 
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Network  Connectivity 

The  Story  of  the  Pipes 


There  are  Pipes  within  Pipes 


Some  Pipe  Characteristics 


Big  Pipe 

Name 

Type 

Size 

Flow 


CT*r  Name^ 

2.  Type 

3.  Control 

4.  Flow  medium 

5.  Size 


14. 

15. 


Start  point 
Branches 


16.  Linkages 


6.  Flow  material 


7. 

8. 
9. 


Inner  pipes 
Format 
Flow  rate 


17. 

18. 

19. 

20. 
21. 
22. 


Have  Now 


Still  Need 


Clor^lowdirectipE>  23. 

11.  Flow  capacity  24. 

12.  Status  25. 

13.  Calibrated  26. 


Pumps 
Drives 
Flow  from 
Transitions 
Filters 
Flow  to 
Mix  content 
End  point 
Security 
Recorded 
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Recommended  CRC  Operational 
Structure  (add  to  AFI  13-lAOC,  Vol.  3) 


inS>/l3  Notional  Example:  AOR  Activity 


Number  Unidentified  Over  Time 


Time 


UK  P  A  F  N  S  H  UD  61 
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Some  JEFX  2004  Products 


Providing  a  scientific  approach  &  quantitative  " 
response  to  the  assessment  process  | 

•  Designed  schema  and  definitions  for  BCC-X  processes 

•  Measures  of  merit,  and  data  collection  forms  for  information 

•  Communication  diagrams  (paths,  patterns,  message  types,  rates)  outlining 
internal  &  external  relationships  of  section/individual  station  operators 

•  Operator  communications,  RFI,  coordination,  directive  orders, 
information  updates,  and  decision  making  responsibilities 

•  Warfighter  information,  ^‘workload”  rates,  targets  prosecuted,  command 
interest  operational  displays 

•  AFEO  assessment  reports,  numerous  observations,  and  comments  on 
operations  and  leadership 

•  325  plus  page  BCC-X  at  JEFX  04  Report 


Lessons  Learned  JEFX  04  Assessments 


•  They  are  optimistic  warriors 

•  They  are  loyal  to  a  fault 

•  They  don’t  know  ‘‘how  much” 

•  They  don’t  know  “how  long” 

•  Learn  mostly  from  OJT 

•  They  use  rules  of  thumb 

•  They  are  weakly  trained 

•  No  automated  data  capture  tools 

•  No  bench  marks  on  performance 

•  Need  technical  SMEs  to  assess 


•  Operators  suffice  (good  enough) 

•  They  are  “minimize”  learners 

•  They  use  old  process  w/new  tool 

•  They  circumvent  the  tools 

•  All  Info  has  a  quality  index 

•  They  might  talk,  but  don’t  write 

•  Experience  counts  most 

•  They  can’t  type  very  fast 

•  They  don’t  recognize  “tired” 

•  Units  need  to  experience 
experiments 
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0S35  POC  Information 


Mr.  Michael  W.  Garrambone 
Mr.  Thomas  C.  Hughes 


,1 


General  Dynamics 
5200  Springfield  Pike,  Suite  20 
Dayton,  Ohio  45431-1289 
A  :  937-253-4770 
:  937-476-2900 

:  mike.garrambone@gd-ais.com 


:  tom.hughes@gd-ais.com 
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